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•  Research  effort 

•  What  is  a  Dynamic  Decision  Network  (DDN)? 

•  Validation  of  the  DDNs 
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The  Sponsors  of  the  Research 
Defense  Advanced  Research  Projects 

Agency  (DARPA) 
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•  Three  year  seedling  study 

-  Year  1  -  exploratory  study 

-  Years  2  and  3  -  customer  focused 

•  The  general  problem  addressed 
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What  is  a  DDN? 
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•  A  Dynamic  Decision  Network  (DDN)  is  a 
computer  based  decision  engine  that 
recommends  optimal  (or  near  optimal) 
alternatives  for  recurring  dynamic  decisions 

-  particularly  when  it  is  important  to  consider  uncertainty 
and  multiple  competing  objectives. 


Examples  include: 

-  shoot  or  don’t  shoot 

-  divert  a  sensor  platform  or  keep  it  where  it  is 
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Two  Approaches 
To  Optimizing  Dynamic  Decisions 
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•  The  hard  way  (dynamic  programming) 

-  Solve  everything  at  once  by  building  a  model  that 
includes  all  time  periods  AND  all  possibilities 

-  Problem:  the  possibilities  multiply  exponentially 

•  “the  curse  of  dimensionality” 

•  The  somewhat  easier  way  (leapfrog)  -  the  DDN 
approach 

-  Make  our  best  decision  now 
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Dynamic  Decision  Networks 
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(DDNs) 


•  DDNs  integrate  Bayesian  networks  (BNs)  and 
influence  diagrams  (IDs)  into  the  same  application  in 
order  to  optimize  the  synergy  between  these 
techniques. 

•  We  are  developing  software  around  a  current 
software  package  (Netica)  to  perform  the  necessary 
computations. 

•  Short  examples  of  BNs  and  IDs  will  be  first  given. 
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Bayesian  Network  Example 

(in  Netica) 
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•  Structure 

>  Nodes  and  arcs 

>  Marginal  and  conditional  distributions 

•  Purpose 
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Legend: 


Influence  Diagram  Example 

(in  Netica) 
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•  Structure 

>  Similar  to  Bayesian  Networks  with  respect  to  nodes  and  arcs 

>  Value  nodes  and  decision  nodes 

•  Computes  the  expected  utility  of  the  alternatives  across  all  objectives 

(Accomplish  Mission  and  Sufficient  Ammunition) 


Full  Representation  of  a  DDN 
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Computation  Time  Comparisons  (sec) 


•  The  DDNs  proved  to  be  exponentially  faster  than  DP  as 
shown  in  this  sample  of  cases. 


Case 

slices 

alternatives 

objectives 

targets 

reports 

DP 

DDN 

38 

3 

2 

1 

1 

2 

.21 

0.09 

39 

3 

3 

1 

2 

1 

1.101 

0.09 

40 

3 

3 

1 

2 

2 

59.766 

0.06 

41 

3 

4 

1 

3 

1 

51.353 

0.09 

42 

3 

4 

1 

3 

2 

29875.479 

0.12 

43 

3 

2 

2 

1 

1 

.24 

0.093 

44 

3 

2 

2 

1 

2 

.811 

0.09 

45 

3 

3 

2 

2 

1 

8.242 

0.09 

46 

3 

3 

2 

2 

2 

517.214 

0.09 

47 

3 

4 

2 

3 

1 

441.465 

0.09 

48 

3 

4 

2 

3 

2 

* 

0.15 

•  Computer  used  -  Hewlett  Packard  Compaq  NX7000  with  a 
1600  MHZ  Intel  Pentium  (R)  M  processor  and  1GB  of  RAM 
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ID! 


Can  a  DDN  (decision  support  tool)  adequately  replace  human 
decision  making  on  complex,  dynamic,  repetitive  decision  tasks 
that  are  not  mission  critical? 

Approach:  Perform  an  experiment  with  human  subjects  to 
determine  the  adequacy  of  DDNs  as  compared  to  humans. 

-  The  operator’s  responsibility  is  limited  to  a  single  UAV. 

-  Subjects  will  be  presented  a  scenario  and  asked  whether  UAV 
should  be  diverted  or  should  maintain  current  task 

A  panel  of  experts  will  determine  “correct”  decisions  for  a  series 
of  scenarios. 

Analysis  will  compare  subjects’  performance  against  the  results 
from  the  experts  and  the  DDN  against  the  “correct”  decisions 
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Morphological  Box 
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for  Scenario  Design  of  Experiment 


Factor 

Levels 

Fuel 

Sufficient  to 
complete 
current  task 
only. 

Sufficient  to 
complete  current 
and  new  task. 

Sufficient  to 
complete  current  or 
new  task. 

Weather 

Clear 

Obstructed 

Terrain 

Mountainous 

Wooded 

Desert 

Urban 

Operator’s 
perception  of 
importance  of 
new  task. 

Very 

unimportant 

Not  important 

Important 

Very 

important 

cost 

High 

Medium 

Low 
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Goal:  Performance  Measures  KB11P| 
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and  Data  Collection  for  N  Scenarios 


Scenario 

Fuel 

Weather 

Terrain 

Perceived  Importance 
Cost 

Congruence 
of  Operator 
Decision  with 
DDN 
Decision 
[Yes  or  No] 

Congruenc 
e  of  DDN 
Decision 
with 

“Preferred 
Decision” 
[Yes  or  No] 

Confidence 
of  Decision 
Maker 
[1  to  7 
scale] 

Time  to 
Make  the 
Decision 
[seconds] 

1 

Sufficient  fuel  to  complete 
current  task  only. 
Obstructed 

Wooded 

Important 

High 

Yes 

Yes 

4 

20 

2 

Sufficient  fuel  to  complete 
current  and  new  task. 
Clear 

No 

Yes 

2 

60 

Urban 

Very  important 

Low 
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Participants  and  Scenarios 
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•  Participants: 

-  Representative  of  real  decision  makers 

-  Number:  at  least  25  participants  based  on  a  confidence  level 
of  95% 

•  Scenarios: 

-  Minimum  number1 
=  #  Levels  -  #  Factors  +  1 

-  Additional  scenarios  will 
improve  reliability  of  sample 


Factor 

Levels 

Fuel 

Sufficient  to 
complete 
current  task 
only. 

Sufficient  to 
complete  current 
and  new  task. 

Sufficient  to 
complete  current  or 
new  task. 

Weather 

Clear 

Obstructed 

Terrain 

Mountainous 

Wooded 

Desert 

Urban 

Operator’s 
perception  of 
importance  of 
new  task. 

Very 

unimportant 

Not  important 

Important 

Very 

important 

cost 

High 

Medium 

Low 

1  Hair,  Anderson,  Tatham,  and  Black  (1998).  Multivariate  data  analysis. 
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Analysis  Approach 
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•  Goal:  Compare  performance  of  experts,  DDNs,  and 
untrained  participants. 

•  Method:  Given  ordinal-level  data,  tentatively  use  a 
Kruskal-Wallis  one-way  ANOVA. 
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Questions  /  Comments 
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